Electronic device and method for processing handwriting input thereof

ABSTRACT

Disclosed is an electronic device for processing a handwriting input and including a touch screen, a processor operatively connected with the touch screen, and a memory operatively connected with the processor, wherein the memory stores instructions, which when executed, cause the processor to control the electronic device to perform handwriting recognition for a first handwriting input of a user displayed on the touch screen, to convert the first handwriting input into a text, identify at least one of an attribute or characteristic of the first handwriting input, apply at least one of the identified attribute or characteristic to the converted text, and in response to a request for conversion of the first handwriting input, replace the first handwriting input into a text (herein after, a first rich text) to which the identified at least one of the attribute or characteristic has been applied.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is based on and claims priority under 35 U.S.C. § 119to Korean Patent Application No. 10-2019-0095736, filed on Aug. 6, 2019,in the Korean Intellectual Property Office, the disclosure of which isincorporated by reference herein in its entirety.

BACKGROUND 1. Field

The disclosure relates to an electronic device, and a method forprocessing a handwriting input in the electronic device.

2. Description of Related Art

Electronic devices, such as a mobile terminal, a smart phone, and awearable terminal, can provide various functions for music playing,navigation, short-range wireless communication including Bluetooth™,wireless fidelity (Wi-Fi), and near field communication (NFC),fingerprint recognition, photographing or video shooting, and electronicpayment, for example.

The electronic device can also include a writing input function whichuses an input device, such as a stylus pen, an electronic pen, or auser's finger, and can provide a writing recognition function ofconverting a writing input into a text.

SUMMARY

With a writing input, a user can configure various attributes such ascolor, thickness, and writing brush type. The writing input can havevarious characteristics such as letter size, line type, alignment,writing style, pressure, slope, and stroke characteristic including aslope of a stroke end. However, the electronic device conventionallyconverts the writing input into a text having a designated attributewithout considering an attribute and characteristic of the writing inputat the time of writing recognition. Thus, the writing recognitionfunction has a problem and/or inconvenience in that a user has to changethe attribute of the text after completing the text conversion.

The writing recognition function can be automatically performedaccording to a user's command after the writing input has been completedor when it is determined that the writing input has been completed, suchas when no writing input is detected during a predetermined time. Thus,the writing recognition function is further inconvenient since a user ofan electronic device cannot know the writing recognition result untilprior to completion of the writing recognition.

As such, there is a need in the art for an electronic device that moreconveniently enables a user to handle attribute modification anddetermine writing recognition results during a writing input function.

Aspects of the disclosure are to address at least the above-mentionedproblems and/or disadvantages and to provide at least the advantagesdescribed below. Accordingly, an aspect of the disclosure is to providean electronic device that considers an attribute and/or characteristicof a handwriting input, to perform handwriting recognition. Anotheraspect of the disclosure is to provide an electronic device thatperforms handwriting recognition for a handwriting input in real time,and presents a preview of the handwriting recognition result.

In accordance with an aspect of the disclosure, an electronic device mayinclude a touch screen, a processor operatively connected with the touchscreen, and a memory operatively connected with the processor, whereinthe memory stores instructions, which when executed, cause the processorto control the electronic device to perform handwriting recognition fora first handwriting input of a user displayed on the touch screen, toconvert the first handwriting input into a text, identify at least oneof an attribute or characteristic of the first handwriting input, applyat least one of the identified attribute or characteristic to theconverted text, and in response to a request for conversion of the firsthandwriting input, replace the first handwriting input into a text(hereinafter, a first rich text) to which the identified at least one ofthe attribute or characteristic has been applied.

In accordance with another aspect of the disclosure, a method forprocessing a handwriting input in an electronic device includesconverting a first handwriting input of a user into a text by performinghandwriting recognition for the first handwriting input, identifying atleast one of an attribute or characteristic of the first handwritinginput, applying at least one of the identified attribute orcharacteristic to the converted text, and replacing, in response to arequest for conversion of the first handwriting input, the firsthandwriting input into a text (hereinafter, a first rich text) to whichthe identified at least one of the attribute or characteristic has beenapplied.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of certainembodiments of the disclosure will be more apparent from the followingdetailed description, taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a block diagram of an electronic device within a networkenvironment according to an embodiment;

FIG. 2 illustrates a method for processing a handwriting input in anelectronic device according to an embodiment;

FIG. 3 illustrates a method for processing a handwriting input in anelectronic device according to an embodiment;

FIG. 4A and FIG. 4B illustrate a method for processing a handwritinginput in an electronic device according to an embodiment;

FIG. 5 illustrates a method for converting a handwriting input into atext in an electronic device according to an embodiment;

FIG. 6A and FIG. 6B illustrate a method for converting a handwritinginput into a text in an electronic device according to an embodiment;

FIG. 7 illustrates a method for processing a handwriting input in anelectronic device according to an embodiment;

FIGS. 8A, 8B, 8C, 8D and 8E illustrate a method for processing ahandwriting input in an electronic device according to an embodiment;

FIG. 9A illustrates a method for converting a handwriting input into atext in an electronic device according to an embodiment;

FIG. 9B illustrates a method for converting a handwriting input into atext in an electronic device according to an embodiment;

FIG. 10 illustrates a method for adding a text by using a handwritinginput in an electronic device according to an embodiment;

FIGS. 11A and 11B illustrate a method for adding a text by using ahandwriting input in an electronic device according to an embodiment;

FIG. 12 illustrates a method for revising a text by using a handwritinginput in an electronic device according to an embodiment; and

FIG. 13 illustrates a method for revising a text by using a handwritinginput in an electronic device according to an embodiment.

DETAILED DESCRIPTION

Hereinafter, embodiments will be described in detail with reference tothe accompanying drawings. Although specific embodiments are illustratedin the drawings and described in detail with reference thereto, this isnot to limit the embodiments to specific forms. For example, it would beobvious to a person skilled in the art to which the disclosure pertainsthat the embodiments can be modified. Detailed descriptions of knownfunctions and/or configurations will be omitted for the sake of clarityand conciseness.

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to an embodiment.

Referring to FIG. 1, the electronic device 101 may communicate with anelectronic device 102 via a first network 198 (e.g., a short-rangewireless communication network), or an electronic device 104 or a server108 via a second network 199 (e.g., a long-range wireless communicationnetwork). The electronic device 101 may communicate with the electronicdevice 104 via the server 108. The electronic device 101 may include aprocessor 120, memory 130, an input device 150, a sound output device155, a display device 160, an audio module 170, a sensor module 176, aninterface 177, a haptic module 179, a camera module 180, a powermanagement module 188, a battery 189, a communication module 190, asubscriber identification module (SIM) card 196, or an antenna module197. At least one (e.g., the display device 160 or the camera module180) of the components may be omitted from the electronic device 101, orone or more other components may be added in the electronic device 101.Some of the components may be implemented as single integratedcircuitry. For example, the sensor module 176 (e.g., a fingerprintsensor, an iris sensor, or an illuminance sensor) may be implemented asembedded in the display device 160 (e.g., a display).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 101 coupled with theprocessor 120, and may perform various data processing or computation.As at least part of the data processing or computation, the processor120 may load a command or data received from another component (e.g.,the sensor module 176 or the communication module 190) in volatilememory 132, process the command or the data stored in the volatilememory 132, and store resulting data in non-volatile memory 134. Theprocessor 120 may include a main processor 121 (e.g., a centralprocessing unit (CPU) or an application processor (AP)), and anauxiliary processor 123 (e.g., a graphics processing unit (GPU), animage signal processor (ISP), a sensor hub processor, or a communicationprocessor (CP)) that is operable independently from, or in conjunctionwith, the main processor 121. Additionally or alternatively, theauxiliary processor 123 may be adapted to consume less power than themain processor 121, or to be specific to a specified function. Theauxiliary processor 123 may be implemented as separate from, or as partof the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one component (e.g., the display device 160,the sensor module 176, or the communication module 190) among thecomponents of the electronic device 101, instead of the main processor121 while the main processor 121 is in an inactive (e.g., sleep) state,or together with the main processor 121 while the main processor 121 isin an active state (e.g., executing an application). The auxiliaryprocessor 123 (e.g., an ISP or a CP) may be implemented as part ofanother component (e.g., the camera module 180 or the communicationmodule 190) functionally related to the auxiliary processor 123. Thememory 130 may store data used by at least one component (e.g., theprocessor 120 or the sensor module 176) of the electronic device 101.The data may include, for example, software (e.g., the program 140) andinput data or output data for a command related to the data. The memory130 may include the volatile memory 132 or the non-volatile memory 134.

The program 140 may be stored in the memory 130 as software and mayinclude an operating system (OS) 142, middleware 144, or an application146.

The input device 150 may receive a command or data to be used by anothercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., user) of the electronic device 101. The input device150 may include a microphone, a mouse, a keyboard, or a digital pen(e.g., a stylus pen).

The sound output device 155 may output sound signals to the outside ofthe electronic device 101. The sound output device 155 may include aspeaker or a receiver. The speaker may be used for general purposes,such as playing multimedia or playing record, and the receiver may beused for incoming calls. The receiver may be implemented as separatefrom, or as part of the speaker.

The display device 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display device 160 mayinclude a display, a hologram device, or a projector and controlcircuitry to control a corresponding one of the display, hologramdevice, and projector. The display device 160 may include touchcircuitry adapted to detect a touch, or sensor circuitry (e.g., apressure sensor) adapted to measure the intensity of force incurred bythe touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. The audio module 170 may obtain the sound via the inputdevice 150, or output the sound via the sound output device 155 or aheadphone of an external electronic device (e.g., an electronic device102) directly (e.g., wiredly) or wirelessly coupled with the electronicdevice 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. The sensor module 176 may include a gesture sensor, agyro sensor, an atmospheric pressure sensor, a magnetic sensor, anacceleration sensor, a grip sensor, a proximity sensor, a color sensor,an infrared (IR) sensor, a biometric sensor, a temperature sensor, ahumidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wiredly) orwirelessly. The interface 177 may include a high definition multimediainterface (HDMI), a universal serial bus (USB) interface, a securedigital (SD) card interface, or an audio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). The connectingterminal 178 may include a HDMI connector, a USB connector, a SD cardconnector, or an audio connector (e.g., a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. The haptic module 179 may include a motor, a piezoelectricelement, or an electric stimulator.

The camera module 180 may capture a still image or moving images. Thecamera module 180 may include one or more lenses, image sensors, ISPs,or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. The power management module 188 may beimplemented as at least part of a power management integrated circuit(PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. The battery 189 may include a primary cell whichis not rechargeable, a secondary cell which is rechargeable, or a fuelcell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 101 and the external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication via the established communication channel. Thecommunication module 190 may include one or more CPs that are operableindependently from the processor 120 (e.g., the application processor(AP)) and supports a direct (e.g., wired) communication or a wirelesscommunication. The communication module 190 may include a wirelesscommunication module 192, such as a cellular communication module, ashort-range wireless communication module, or a global navigationsatellite system (GNSS) communication module, or a wired communicationmodule 194, such as a local area network (LAN) communication module or apower line communication (PLC) module. A corresponding one of thesecommunication modules may communicate with the external electronicdevice via the first network 198 (e.g., a short-range communicationnetwork, such as Bluetooth™, Wi-Fi direct, or infrared data association(IrDA)) or the second network 199 (e.g., a long-range communicationnetwork, such as a cellular network, the Internet, or a computer network(e.g., LAN or wide area network (WAN)). These various types ofcommunication modules may be implemented as a single component (e.g., asingle chip), or may be implemented as multi components (e.g., multichips) separate from each other. The wireless communication module 192may identify and authenticate the electronic device 101 in acommunication network, such as the first network 198 or the secondnetwork 199, using subscriber information (e.g., international mobilesubscriber identity (IMSI)) stored in the SIM card 196.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. The antenna module 197 may include an antennaincluding a radiating element composed of a conductive material or aconductive pattern formed in or on a substrate, such as a printedcircuit board (PCB). The antenna module 197 may include a plurality ofantennas. In such a case, at least one antenna appropriate for acommunication scheme used in the communication network, such as thefirst network 198 or the second network 199, may be selected by thecommunication module 190 (e.g., the wireless communication module 192)from the plurality of antennas. The signal or the power may then betransmitted or received between the communication module 190 and theexternal electronic device via the selected at least one antenna.Another component, such as a radio frequency integrated circuit (RFIC),other than the radiating element may be additionally formed as part ofthe antenna module 197.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

Commands or data may be transmitted or received between the electronicdevice 101 and the external electronic device 104 via the server 108coupled with the second network 199. Each of the electronic devices 102and 104 may be a device of a same type as, or a different type, from theelectronic device 101. All or some of operations to be executed at theelectronic device 101 may be executed at one or more of the externalelectronic devices 102, 104, or 108. For example, if the electronicdevice 101 should perform a function or a service automatically, or inresponse to a request from a user or another device, the electronicdevice 101, instead of, or in addition to, executing the function or theservice, may request the one or more external electronic devices toperform at least part of the function or the service. The one or moreexternal electronic devices receiving the request may perform the atleast part of the function or the service requested, or an additionalfunction or an additional service related to the request, and transferan outcome of the performing to the electronic device 101. Theelectronic device 101 may provide the outcome, with or without furtherprocessing of the outcome, as at least part of a reply to the request.To that end, a cloud, distributed, or client-server computing technologymay be used, for example.

According to an embodiment, an electronic device (e.g., the electronicdevice 101) may include a touch screen (e.g., the display device 160), aprocessor (e.g., the processor 120) operatively connected with the touchscreen, and a memory (e.g., the memory 130) operatively connected withthe processor, wherein the memory may store instructions, which whenexecuted, cause the processor to control the electronic device to:perform handwriting recognition for a first handwriting input of a userdisplayed on the touch screen, to convert the first handwriting inputinto a text, identify at least one of an attribute or characteristic ofthe first handwriting input, apply at least one of the identifiedattribute or characteristic to the converted text, and in response to arequest for conversion of the first handwriting input, replace the firsthandwriting input into a text (hereinafter, a first rich text) to whichthe identified at least one of the attribute or characteristic has beenapplied.

The memory may further store instructions cause the processor to controlthe electronic device to present, before replacing the first handwritinginput into the first rich text, a preview window comprising the firstrich text to a location adjacent to the first handwriting input.

The memory may further store instructions cause the processor to controlthe electronic device to copy, in response to a request for copy of thefirst rich text being detected, the first rich text comprised in thepreview window, or display, in response to a request for obtaining ofthe first rich text being detected, the first handwriting input and thefirst rich text, together.

The memory may further store instructions cause the processor to controlthe electronic device to detect the first handwriting input and, inresponse to an additional handwriting input not being detected during aspecified time after the detecting of the first handwriting input or inresponse to a handwriting recognition command by a user being received,perform the handwriting recognition for the first handwriting input.

The memory may further store instructions cause the processor to controlthe electronic device to re-perform, in response to editing of a portionof the first handwriting input, the handwriting recognition for a rangewhich has been specified with a criterion of the portion.

The preview window may comprise a rich text for a specified range of thefirst handwriting input, wherein the specified range may comprise oneline, a plurality of lines which have been specified with a criterion ofa location where the handwriting input has been provided, or one screen,and may be changeable by a user.

The memory may further store instructions cause the processor to controlthe electronic device to identify, in response to a second handwritinginput being added after replacing the first handwriting input into thefirst rich text, a relationship between the second handwriting input andthe first rich text, determine a location of a second rich text havingconverted the second handwriting input based on the identifiedrelationship, and display the second rich text in the determinedlocation.

The memory may further store instructions cause the processor to controlthe electronic device to replace, in response to a third handwritinginput overlapped with at least part of the first rich text being addedafter replacing the first handwriting input into the first rich text, atleast part of the first rich text into a third rich text havingconverted the third handwriting input.

The memory may further store instructions cause the processor to controlthe electronic device to classify the first handwriting input into atext and a non-text, perform line separation for the classified text,identify at least one target line which will perform the handwritingrecognition, and perform the handwriting recognition for the entire orpart of the identified at least one target line.

The memory may further store instructions cause the processor to controlthe electronic device to output an error message in response to the lineseparation not being possible or the handwriting recognition not beingpossible.

FIG. 2 illustrates a method for processing a handwriting input in anelectronic device according to an embodiment.

Referring to FIG. 2, in operation 201, a processor (e.g., the processor120) of the electronic device (e.g., the electronic device 101) may turnON (or enable) a preview function for a handwriting input. The previewfunction may recognize a user handwriting input which uses an inputdevice (e.g., the input device 150) (e.g., a digital pen, a stylus pen,a finger, etc.), and present its recognition result (e.g., a text)through a preview window.

In response to the execution of an application in which a handwritinginput is possible (below, a handwriting app) (e.g., a memo app, a noteapp, etc.), the processor may automatically turn ON the previewfunction. The preview function may be turned ON or OFF by a user througha configuration menu of the electronic device, a menu included in thehandwriting app, or a specified gesture input.

In operation 203, the processor may sense a handwriting input. Forexample, the processor may sense the handwriting input through a touchcircuit (e.g., a capacitive touch circuit, an electromagnetic inductiontouch circuit, etc.) included in a display (e.g., the display device160).

In operation 205, the processor may perform handwriting recognition. Forexample, the processor may convert the handwriting input into a textthrough the handwriting recognition. A detailed description of the textconversion method will be made later with reference to FIGS. 5, 6A and6B.

In operation 207, the processor may identify an attribute and/orcharacteristic of the handwriting input. For example, the processor mayidentify the attribute of the handwriting input, such as a color, athickness, and a writing brush type, and/or the characteristic of thehandwriting input including a letter size, a line, alignment, a slope,and a stroke characteristic (e.g., a slope of a stroke end).

In operation 209, the processor may apply the identified attributeand/or characteristic to the text. For example, the processor mayseparate a line of the text correspondingly to line separation of thehandwriting input, align the line of the text correspondingly to linealignment of the handwriting input, determine a color of the text tocorrespond to a color of the handwriting input, determine a size of thetext based on a size of the handwriting input, determine a thickness ofthe text (e.g., determine bold applying or non-applying) correspondinglyto a thickness of the handwriting input (or a pressure at handwritinginput), determine a slope of the text (e.g., determine slope shapeapplying or non-applying) corresponding to a slope of the handwritinginput (or a slope of an electronic pen), and determine the applying ornon-applying of serif to the text according to the pen type selected atthe handwriting input (or a stroke characteristic of the handwritinginput).

In operation 211, the processor may display the text (below, rich text)to which the attribute and/or characteristic has been applied, on apreview window in real time. For example, the processor may display thepreview window including the rich text immediately correspondingly tothe handwriting input or when it is determined that the handwritinginput has been completed.

FIG. 3 illustrates the method for processing the handwriting input inthe electronic device according to an embodiment.

In screenshots 310, 320 and 330 of FIG. 3, the processor may performhandwriting recognition in real time correspondingly to sensing of ahandwriting input (e.g., a stroke input), and display a preview window301 in a location (e.g., above) adjacent to the handwriting input, anddisplay a recognized rich text on the preview window 301 in real time.As illustrated in screenshot 340 of FIG. 3, in response to a part of thehandwriting input being removed, the processor may re-performhandwriting recognition, or remove a text corresponding to the removedhandwriting input.

The preview window 301 may be movable. For example, the processor maytouch the preview window 301 and then move the preview window 301correspondingly to a drag input of a moving user.

The processor may display a visual element (e.g., a dotted-line box) 302indicating an area in which handwriting recognition is being executed.The visual element 302 may include items 302 a and 302 b for adjusting asize of the visual element 302. By using the items 302 a and 302 b, auser may change a size of the area which will perform the handwritingrecognition. For example, the user may select (touch or drag) the firstitem 302 a and extend a size of the visual element 302 upward, and mayselect (touch or drag) the second item 302 b and extend the size of thevisual element 302 downward. The preview window 301 may be changed insize in response to a change of the size of the visual element 302. Thevisual element 302 may be changeable in size leftward and rightward.

In response to the change of the size of the handwriting recognitionarea, the processor may re-perform handwriting recognition for thechanged entire area. The processor may perform handwriting recognitionfor an added recognition area and add the handwriting recognition resultof the added recognition area to the exiting the handwriting recognitionresult. Accordingly, the processor may improve the performance (e.g.,speed) of the handwriting recognition (e.g., document layout analysis,line separation, and/or text recognition) of the electronic device.

FIGS. 4A and 4B illustrate the method for processing the handwritinginput in the electronic device according to an embodiment.

In response to determining that the handwriting input has beencompleted, the processor may display a preview window. As illustrated inscreenshot 410 of FIG. 4A and screenshot 450 of FIG. 4B, the processormay sense a handwriting input through an electronic pen 401. In responseto an additional handwriting input not being sensed during apredetermined time (e.g., 300 milliseconds (ms)) after the sensing ofthe handwriting input, as illustrated in screenshot 420 of FIG. 4A andscreenshot 460 of FIG. 4B, the processor may determine an area below ahandwriting area in which handwriting recognition has been performed,and display a visual element (e.g., a box) 402 representing thehandwriting area, and display a preview window 403 above the handwritingarea. By touching (e.g., tap) the handwriting area, the preview window403 may display a guide phrase 403 a notifying that text conversion ispossible.

In response to the touch being sensed in the handwriting area, asillustrated in screenshot 430 of FIG. 4A and screenshot 470 of FIG. 4B,the processor may display the recognition result (e.g., rich text) 403 bof the handwriting input on the preview window 403. By touching (e.g.,tapping) the preview window 403, the processor may display a guidephrase 403 c notifying being capable of converting the handwriting inputinto a text on the preview window 403, together.

Referring back to FIG. 2, in FIGS. 4A and 4B, the processor may performoperations 205 to 209 before display of the preview window 403 isrequested (e.g., before the handwriting area is touched). The processormay perform some of operations 205 to 209 as a background before displayof the preview window 403 is requested and perform remaining someoperations after display of the preview window 403 has been requested.The processor may perform operations 205 to 209 after selection of thehandwriting area.

Operation 211 may be omitted in response to a user turning OFF thepreview function.

In operation 213, the processor may identify whether a conversionrequest is sensed. In examples, the processor may identify whether aspecified touch input (e.g., a touch/a long touch/a double touch, etc.)is sensed in the preview window, may identify whether an input of aspecified button of an electronic pen is sensed, and may identifywhether a convert menu displayed at one side of the preview window isselected (e.g., touched).

In response to the conversion request not being sensed as theidentifying result of operation 213, the processor may proceed tooperation 217 described later. However, in response to the conversionrequest being sensed as the identifying result of operation 213, inoperation 215, the processor may convert (or replace) the handwritinginput into the rich text. For example, as illustrated in screenshot 350of FIG. 3, the processor may remove the handwriting input, and display arich text 305 to which the attribute and/or characteristic of thehandwriting input has been applied. Similarly, as illustrated inscreenshot 440 of FIG. 4A and screenshot 480 of FIG. 4B, the processormay remove the handwriting input, and display a rich text 405 to whichthe attribute and/or characteristic of the handwriting input has beenapplied.

In operation 217, the processor may identify whether the handwritinginput, such as the handwriting app, is ended. In response to thehandwriting input not being ended as the identifying result of operation217, the processor may return to operation 203 and repeat theaforementioned operations. However, in response to the handwriting inputbeing ended as the identifying result of operation 217, the processormay end the handwriting input processing procedure.

FIG. 5 illustrates a method for converting a handwriting input into atext in an electronic device according to an embodiment. FIGS. 6A and 6Billustrate the method for converting the handwriting input into the textin the electronic device according to an embodiment.

Referring to FIG. 5, 6A and FIG. 6B, in operation 501, a processor(e.g., the processor 120) may classify a text and a non-text by usingdocument layout analysis (DLA) every editing (e.g., input or removal)sensing. The classification may be performed in real time every strokeinput. As illustrated in FIG. 6A, the processor may classify drawinginputs 601 a and 601 b into a non-text, and classify handwriting inputs603 a, 603 b, and 603 c into a text, based on a database previouslystored for the sake of classification of the text and the non-text. Thedatabase may be provided by obtaining a feature from non-text datasamples and text data samples, or may be provided by training thenon-text data samples and the text data samples by using an artificialintelligence (e.g., deep learning).

The processor may classify a text and a non-text based on a set rulesuch as limitations of a height of an inputted stroke and a length ofthe stroke.

In operation 503, the processor may perform line separation for thehandwriting inputs classified into the text. For example, the processormay perform line separation based on the set rule (e.g., a strokesequence of handwriting and an input location thereof). For example, theprocessor may separate the handwriting inputs 603 a, 603 b, and 603 cclassified into the texts of FIG. 6A, as mutually different lines.

Operations 501 and 503 may be performed for the entire page every strokeinput. However, in response to including several pages (assuming onescreen as one page), the handwriting recognition may be delayed. As inscreenshot 610 of FIG. 6B, the processor may perform operations 501 and503 for a current screen (i.e., page) 611. Alternatively, as inscreenshot 620 of FIG. 6B, the processor may perform operations 501 and503 for a predetermined range (e.g., a line where editing has beensensed, a front line, and a rear line) 621 with a criterion of a linewhere editing has been sensed. The processor may identify a line rangethat the sensed editing may affect (e.g., identify lines intruded by anadded stroke with a criterion of a Y-axis (i.e., a vertical direction)),and perform operations 501 and 503 for the identified line range.

In operation 505, the processor may identify a target line where editinghas been provided. For example, in response to a stroke being added(inputting a new stroke, undoing after stroke erasing, or redoing afterundoing), the processor may identify a line where the stroke has beenadded, as the target line. In response to a stroke being erased (e.g.,being undone after stroke inputting, being redone after being undone, orbeing erased), the processor may identify a line where the stroke hasbeen erased, as the target line.

In operation 507, the processor may perform handwriting recognition forall or part of the target line. The target line may be set as one lineand, as described in reference to FIG. 3, may be extended into aplurality of lines correspondingly to a user's input to a visual elementrepresenting the target line. In response to the handwriting recognitionnot being possible, the processor may control a display to output anerror message. A detailed description of this will be made later withreference to FIG. 9B.

FIG. 7 illustrates a method for processing a handwriting input in anelectronic device according to an embodiment of the present disclosure.FIGS. 8A, 8B, 8C, 8D and 8E illustrate the method for processing thehandwriting input in the electronic device according to an embodiment ofthe present disclosure.

Referring to FIGS. 7, 8A, 8B, 8C, 8D and 8E, in operation 701, aprocessor (e.g., the processor 120) of the electronic device (e.g., theelectronic device 101) may display a screen including a handwritinginput. For example, as illustrated in screenshot 805 of FIG. 8A,screenshot 825 of FIG. 8B, screenshot 850 of FIG. 8C, and screenshot 865of FIG. 8D, the processor may display handwriting (e.g., a memo) whichhas been previously composed and stored by a user, on a display (e.g.,the display device 160). The handwriting may have various attributesand/or characters.

In operation 703, the processor may sense a handwriting recognitionrequest. As illustrated in screenshot 805 of FIG. 8A and screenshot 825of FIG. 8B, the handwriting recognition request may be sensed through atouch input (e.g., a tap, a double tap, a long touch, etc.) 801 and 828to a part of the handwriting input (i.e., handwriting). As illustratedin screenshot 850 of FIG. 8C, the handwriting recognition request may besensed through a touch input to a text convert menu 851. As illustratedin screenshot 865 of FIG. 8D, the handwriting recognition request may besensed through a touch input to a text obtaining menu 866. Asillustrated in FIG. 8E, the text convert menu 851 and/or the textobtaining menu 866 may be displayed around the handwriting input in afloating scheme 881.

In operation 705, the processor may perform handwriting recognition. Forexample, the processor may convert the handwriting input into a textthrough the handwriting recognition. A detailed description of the textconversion method will be made later with reference to FIG. 9A.

In operation 707, the processor may identify an attribute and/orcharacteristic of the handwriting input. In operation 709, the processormay apply the identified attribute and/or characteristic to the text.Operations 707 and 709 are similar to the aforementioned operations 207and 209 and thus, their detailed description is omitted.

In operation 711, the processor may display the rich text to which theattribute and/or characteristic has been applied, on a preview window.As illustrated in screenshot 810 of FIG. 8A, the processor may display afirst preview window 811 including the handwriting recognition result(e.g., a rich text) in a location (e.g., above) adjacent to a line wherea touch input of a user has been sensed, and display a first visualelement 812 representing a handwriting recognition area. The firstpreview window 811 may be moved in its location correspondingly to auser's input (e.g., touch and drag). As illustrated in screenshot 810 ofFIG. 8A, the handwriting recognition area may be set as one line with acriterion of a point where a touch has been sensed. As illustrated inscreenshots 810 and 815 of FIG. 8A, a size of the handwritingrecognition area may be adjusted correspondingly to a user input 813 tothe first visual element 812. A size of the first preview window 811 maybe also changed correspondingly to a change of the size of thehandwriting recognition area. In response to the change of the size ofthe handwriting recognition area, the processor may re-perform thehandwriting recognition for the changed entire area or performhandwriting recognition only for an added recognition area.

As illustrated in screenshot 830 of FIG. 8B, the processor may display asecond preview window 831 including the handwriting recognition result(e.g., a rich text) and a second visual element 832 representing ahandwriting recognition area, in a location (e.g., above) adjacent to aline where a user's touch input has been sensed. The second previewwindow 831 may be moved in its location correspondingly to a user'sinput (e.g., a touch and drag). As illustrated in screenshots 830 and835 of FIG. 8B, a size of the handwriting recognition area may bechanged correspondingly to a user input 833 of the second visual element832, and a size of the second preview window 831 may be also changedcorrespondingly to the change of the size of the handwriting recognitionarea. In response to the change of the size of the handwritingrecognition area, the processor may re-perform handwriting recognitionfor the entire changed area or perform handwriting recognition only foran added recognition area.

As illustrated in screenshot 855 of FIG. 8C, the processor may display athird preview window 856 including the handwriting recognition result(e.g., a rich text) above a handwriting input, and display a thirdvisual element 857 representing a handwriting recognition area in asurrounding of the handwriting input. The handwriting recognition areamay be set as the entire the handwriting input. A size of thehandwriting recognition area may be adjusted correspondingly to a userinput to the visual element 857. In response to the change of the sizeof the handwriting recognition area, the processor may re-perform thehandwriting recognition for the entire changed area or performhandwriting recognition only for an added recognition area. The thirdpreview window 856 may be moved in its location correspondingly to auser's input (e.g., a touch and drag).

As illustrated in screenshot 870 of FIG. 8D, the processor may display afourth preview window 871 including the handwriting recognition result(e.g., a rich text) in a floating scheme. The fourth preview window 871may include the recognition result of the entire handwriting input. Thelocation of the fourth preview window 871 may be moved correspondinglyto a user's input (e.g., a touch and drag).

Referring back to FIG. 7, operation 711 may be omitted in response to auser turning OFF the preview function.

In operation 713, the processor may identify whether a conversion, copy,or paste request is sensed. In response to the conversion request beingmade as the identifying result of operation 713, in operation 715, theprocessor may convert the handwriting input into the text. For example,as illustrated in screenshots 815 and 820 of FIG. 8A, in response to aspecified first touch input (e.g., a tap or a double tap, etc.) 816being sensed in the first preview window 811, the processor may convertthe handwriting input into the rich text to which the attribute and/orcharacteristic of the handwriting input has been applied. The convertedrich text may be displayed in each line by using a separate text box, ormay be displayed where a line is distinguished in one text box.

For example, as illustrated in screenshots 835 and 840 of FIG. 8B, inresponse to a specified first touch input 836 being sensed in the secondpreview window 831, the processor may convert the handwriting input intothe rich text to which the attribute and/or characteristic of thehandwriting input has been applied. The converted rich text may bedisplayed in each line by using a separate text box or be displayedwherein a line is distinguished in one text box. As illustrated inscreenshots 840 and 845 of FIG. 8B, in response to sensing that a touchinput 843 to another handwriting input 841 is not converted, theprocessor may perform operations 705 to 711 and display a fifth previewwindow 846 and a fifth visual element 847.

As illustrated in screenshots 855 and 860 of FIG. 8C, in response to atouch input to a convert menu 856 a included in the third preview window856 being sensed, the processor may convert the handwriting input intothe rich text to which the attribute and/or characteristic of thehandwriting input has been applied. The converted rich text may bedisplayed in each line by using a separate text box or may be displayedwhere a line is distinguished in one text box.

In response to the copy request being made as the identifying result ofoperation 713, in operation 717, the processor may copy the text. Inexamples, in response to a specified second touch input (e.g., a longtouch) being sensed in the first preview window 811 of FIG. 8A, theprocessor may copy the rich text included in the first preview window811. In response to a specified second touch input (e.g., a long touch)being sensed in the second preview window 831 of FIG. 8B, the processormay copy the rich text included in the second preview window 831. Inresponse to sensing a touch input to a copy menu 856 b included in thethird preview window 856 of FIG. 8C, the processor may copy the richtext included in the third preview window 856. In response to sensing atouch input to a copy menu 871 b included in the fourth preview window871 of FIG. 8D, the processor may copy the rich text included in thefourth preview window 871. The copied rich text may be pasted in ahandwriting app which is being currently executed or another app (e.g.,a letter app, a webpage, or a short message service (SMS) app) where atext input is possible.

In response to the paste request being made as the identifying result ofoperation 713, in operation 719, the processor may paste the rich textto a specified area. For example, as illustrated in screenshots 870 and875 of FIG. 8D, in response to a touch input to a paste menu 871 aincluded in the fourth preview window 871 being sensed, the processormay paste, to an input field 876, the rich text to which the attributeand/or characteristic of the handwriting input has been applied, anddisplay a virtual keyboard 877 capable of editing the rich text includedin the input field 876. The pasted rich text may be displayed in eachline by using a separate text box or may be displayed wherein a line isdistinguished in one text box. The fourth preview window 871 may includean undo menu 871 c undoing handwriting recognition, and a languageselect menu 871 d capable of selecting a recognition language.

In operation 721, the processor may identify whether an end command issensed. In response to the end command not being sensed as theidentifying result of operation 721, the processor may return tooperation 703 and repeat the aforementioned operations. In response tothe end command being ended as the identifying result of operation 721,the processor may end a handwriting input processing procedure.

In response to a request for obtaining of the rich text being sensed,the processor may control a display to display the handwriting input andthe rich text together, without removing the handwriting input. Forexample, in response to sensing of the obtaining request, the processormay control the display to display the rich text below the handwritinginput.

FIG. 9A illustrates a method for converting a handwriting input into atext in an electronic device according to an embodiment. FIG. 9Billustrates the method for converting the handwriting input into thetext in the electronic device according to an embodiment.

Referring to FIGS. 9A and 9B, in operation 901, a processor may performdocument layout analysis (DLA) for a specified area (e.g., a handwritingrecognition area), to classify a text and a non-text. The specified areamay include one line or a set number of lines including a point where auser's touch input has been sensed.

In operation 903, the processor may perform line separation forhandwriting inputs classified into the text. For example, the processormay perform the line separation based on a set rule (e.g., a strokesequence of handwriting and an input location thereof).

In operation 905, the processor may perform handwriting recognition forthe specified area. The processor may perform the handwritingrecognition as a background for the entire handwriting input or ahandwriting input included in a current screen. By previously performinghandwriting recognition for a non-specified area, the handwritingrecognition result may be quickly presented in response to the specifiedarea being extended by a user.

As illustrated in FIG. 9B, the processor may control a display to outputan error message 911 in response to handwriting recognition not beingpossible. For example, the processor may obtain slope information of aline at the time of handwriting recognition based on the knowntechnologies (e.g., linear regression, a method for calculating an angleat which an aspect ratio of a corresponding line is minimized, etc.),and control the display to output the error message 911 in response tothe slope information being greater than a specified angle.Alternatively, in response to the line separation failing in operation903, the processor may control the display to output the error message911.

FIG. 10 illustrates a method for adding a text by using a handwritinginput in an electronic device according to an embodiment of the presentdisclosure. FIGS. 11A and 11B illustrate the method for adding the textby using the handwriting input in the electronic device according to anembodiment of the present disclosure.

Referring to FIGS. 10, 11A and 11B, in operation 1001, a processor(e.g., the processor 120) may identify whether a handwriting input isadded after operation 215. For example, as illustrated in screenshots1110, 1120 and 1130 of FIG. 11A, when a first handwriting input “loved”1111 has completed conversion into a first text 1121, a user may performan additional handwriting input (below, a second handwriting input) “Wemet” 1131 by using an electronic pen 1101.

In response to the handwriting input not being added as the identifyingresult of operation 1001, the processor may proceed to operation 217where the method ends. However, in response to the handwriting inputbeing added as the identifying result of operation 1001, in operation1003, the processor may perform handwriting recognition for the addedhandwriting input. For example, in response to adding the secondhandwriting input 1131, the processor may display the recognition resultof the second handwriting input 1131 on a preview window 1132.

In operation 1005, the processor may identify a relation with apreviously converted text. For example, the processor may identifywhether the first text 1121 and the second handwriting input 1131 arecontinuous texts. The processor may identify the relation based on asize, color, or location of the second handwriting input 1131. Forexample, as illustrated in screenshot 1130 of FIG. 11A, in response tothe size and color of the second handwriting input 1131 being similar toa size and color of the first text 1121, and the second handwritinginput 1131 being initiated adjacent to the last letter of the first text1121, the processor may determine that these inputs are related to eachother (e.g., continuous sentences). However, as illustrated inscreenshot 1150 of FIG. 11B, in response to a size and color of a thirdhandwriting input 1151 being different from the size and color of thefirst text 1121 and being spaced more than a predetermined distance fromthe first text 1121, the processor may determine that these inputs arenot related to each other (e.g., separate sentences). The processor mayidentify the relation through context recognition and may determine lineseparation or non-separation based on whether the added handwritinginput is overlapped with the first text 1121 at an X-axis and/or Y-axis.

In operation 1007, the processor may determine a display location of anadditional rich text having converted the added handwriting input, basedon the identifying result. In operation 1009, the processor may displaythe additional rich text in the determined location. For example, asillustrated in screenshot 1140 of FIG. 11A, the processor may display asecond text 1141 having converted the second handwriting input 1131, incontinuation of the first text 1121. The first text 1121 and the secondtext 1141 may be included in one text box. As illustrated in screenshot1160 of FIG. 11B, the processor may display a third text 1161 havingconverted a third handwriting input 1151, in a line different from thatof the first text 1121. The first text 1121 and the third text 1161 maybe included in one text box and the lines may be separated. The firsttext 1121 and the third text 1161 may be included in separate textboxes.

FIG. 12 illustrates a method for revising a text by using a handwritinginput in an electronic device according to an embodiment. FIG. 13illustrates the method for revising the text by using the handwritinginput in the electronic device according to an embodiment.

Referring to FIGS. 12 and 13, in operation 1201, a processor (e.g., theprocessor 120) may identify whether a handwriting input (i.e., a fourthhandwriting input) overlapped with a part of a text is sensed afteroperation 215.

In response to the handwriting input overlapped with the text not beingsensed as the identifying result of operation 1201, the processor mayproceed to operation 217 where the method ends. However, in response tothe handwriting input overlapped with the text being sensed as theidentifying result of operation 1201, in operation 1203, the processormay perform handwriting recognition for the overlapped handwritinginput. For example, as illustrated in screenshot 1310 of FIG. 13, inresponse to a user inputting a handwriting input “West” to overlap witha part “East” of a text intended to be revised, the processor mayperform operations 205 to 211 of FIG. 2, and display a rich text “West”on a preview window 1311.

In operation 1205, the processor may change a part of the rich text intoa recognized rich text. For example, as illustrated in screenshot 1320of FIG. 13, the processor may change the part “East” of the textoverlapped with the handwriting input into a new rich text “West”. Thechange of the text may be performed at the time of conversion request(e.g., a touch input on a preview window, a lapse of a predeterminedtime, a menu input, or a specified button input of an electronic pen,etc.).

According to an embodiment, a method for processing a handwriting inputin an electronic device (e.g., the electronic device 101) includesconverting a first handwriting input of a user into a text by performinghandwriting recognition for the first handwriting input, identifying atleast one of an attribute or characteristic of the first handwritinginput, applying at least one of the identified attribute orcharacteristic to the converted text, and in response to a request forconversion of the first handwriting input, replacing the firsthandwriting input into a text (hereinafter, a first rich text) to whichthe identified at least one of the attribute or characteristic has beenapplied.

The method further includes presenting, before replacing the firsthandwriting input into the first rich text, a preview window comprisingthe first rich text to a location adjacent to the first handwritinginput.

The method further includes at least one of, in response to a requestfor copy of the first rich text being detected, copying the first richtext comprised in the preview window, or in response to a request forobtaining of the first rich text being detected, displaying the firsthandwriting input with the first rich text.

Performing the handwriting recognition may comprise one of performingthe handwriting recognition for the first handwriting input in responseto detecting the first handwriting input, in response to an additionalhandwriting input not being detected during a specified time afterdetecting the first handwriting input, performing the handwritingrecognition for the first handwriting input, or in response to ahandwriting recognition command by a user being received, performing thehandwriting recognition for the first handwriting input.

The method further includes in response to editing of a portion of thefirst handwriting input being detected, re-performing the handwritingrecognition for a range which has been specified with a criterion of theedited portion.

Presenting the preview window may comprise presenting a rich text for aspecified range of the first handwriting input through the previewwindow, wherein the specified range may comprise one line, a pluralityof lines which have been specified with a criterion of a location wherethe handwriting input has been provided, or one screen, and may bechangeable by a user.

The method further includes detecting the addition of a secondhandwriting input after replacing the first handwriting input into thefirst rich text, identifying a relationship between the secondhandwriting input and the first rich text, determining a location of asecond rich text having converted the second handwriting input, based onthe identified relationship, and displaying the second rich text in thedetermined location.

The method further includes detecting the addition of a thirdhandwriting input overlapped with at least part of the first rich textafter replacing the first handwriting input into the first rich text,and replacing at least part of the first rich text into a third richtext having converted the third handwriting input.

Performing the handwriting recognition may comprise classifying thefirst handwriting input into a text and a non-text, performing lineseparation for the classified text, identifying at least one target linewhich will perform the handwriting recognition, and performing thehandwriting recognition for the entire or part of the identified atleast one target line.

The method further includes outputting an error message in response tothe line separation not being possible or the handwriting recognitionnot being possible.

Embodiments of the present disclosure may consider an attribute and/orcharacteristic of a handwriting input at handwriting recognition, toperform text conversion. Embodiments of the disclosure may perform thehandwriting recognition in real time and present the handwritingrecognition result through a preview window, so a user may recognize thehandwriting recognition result in real time. In response to there beinga problem in the handwriting recognition (e.g., erroneous recognition orrecognition impossibility), the user may immediately revise thehandwriting input, thereby enhancing a user's convenience.

The electronic device according to embodiments may be one of varioustypes of electronic devices. The electronic devices may include aportable communication device (e.g., a smartphone), a computer device, aportable multimedia device, a portable medical device, a camera, awearable device, or a home appliance. The electronic devices are notlimited to those described above.

It should be appreciated that embodiments of the disclosure and theterms used therein are not intended to limit the technological featuresset forth herein to particular embodiments and include various changes,equivalents, or replacements for a corresponding embodiment. With regardto the description of the drawings, similar reference numerals may beused to refer to similar or related elements. It is to be understoodthat a singular form of a noun corresponding to an item may include oneor more of the items unless the relevant context clearly indicatesotherwise. As used herein, each of such phrases as “A or B,” “at leastone of A and B,” “at least one of A or B,” “A, B, or C,” “at least oneof A, B, and C,” and “at least one of A, B, or C,” may include any oneof, or all possible combinations of the items enumerated together in acorresponding one of the phrases. As used herein, such terms as “1st”and “2nd,” or “first” and “second” may be used to simply distinguish acorresponding component from another and do not limit the components inimportance or order.

It is to be understood that if a first element is referred to, with orwithout the term “operatively” or “communicatively”, as “coupled with,”“coupled to,” “connected with,” or “connected to” a second element, thisindicates that the first element may be coupled with the second elementdirectly (e.g., wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms “logic,” “logic block,” “part,” or “circuitry”. A module maybe a single integral component, or a minimum unit or part thereof,adapted to perform one or more functions. The module may be implementedin a form of an application-specific integrated circuit (ASIC).

Embodiments as set forth herein may be implemented as software (e.g.,the program 140) including one or more instructions that are stored in astorage medium (e.g., internal memory 136, or external memory 138) thatis readable by a machine (e.g., the electronic device 101). For example,a processor (e.g., the processor 120) of the machine (e.g., theelectronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a compiler or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. The term“non-transitory” indicates that the storage medium is a tangible device,and does not include a signal (e.g., an electromagnetic wave), but thisterm does not differentiate between where data is semi-permanentlystored in the storage medium and where the data is temporarily stored inthe storage medium.

A method according to embodiments of the disclosure may be included andprovided in a computer program product. The computer program product maybe traded as a product between a seller and a buyer. The computerprogram product may be distributed in the form of a machine-readablestorage medium (e.g., compact disc read only memory (CD-ROM)), or bedistributed (e.g., downloaded or uploaded) online via an applicationstore (e.g., PlayStore™), or between two user devices (e.g., smartphones) directly. If distributed online, at least part of the computerprogram product may be temporarily generated or at least temporarilystored in the machine-readable storage medium, such as memory of themanufacturer's server, a server of the application store, or a relayserver.

Each component (e.g., a module or a program) of the above-describedcomponents may include a single entity or multiple entities. One or moreof the above-described components may be omitted, or one or more othercomponents may be added. Alternatively or additionally, a plurality ofcomponents (e.g., modules or programs) may be integrated into a singlecomponent. The integrated component may still perform one or morefunctions of each of the plurality of components in the same or similarmanner as they are performed by a corresponding one of the plurality ofcomponents before the integration. Operations performed by the module,the program, or another component may be carried out sequentially, inparallel, repeatedly, or heuristically, or one or more of the operationsmay be executed in a different order or omitted, or one or more otheroperations may be added.

While the disclosure has been particularly shown and described withreference to certain embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the scope of the subject matter asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a touch screen;a processor operatively connected with the touch screen; and a memoryoperatively connected with the processor, wherein the memory storesinstructions, which when executed, cause the processor to control theelectronic device to: perform handwriting recognition for a firsthandwriting input of a user displayed on the touch screen, to convertthe first handwriting input into a text; identify at least one of anattribute or characteristic of the first handwriting input; apply atleast one of the identified attribute or characteristic to the convertedtext; and in response to a request for conversion of the firsthandwriting input, replace the first handwriting input into a text(hereinafter, a first rich text) to which the identified at least one ofthe attribute or characteristic has been applied.
 2. The electronicdevice of claim 1, wherein the memory further stores instructions causethe processor to control the electronic device to: before replacing thefirst handwriting input into the first rich text, present a previewwindow comprising the first rich text to a location adjacent to thefirst handwriting input.
 3. The electronic device of claim 2, whereinthe memory further stores instructions causing the processor to controlthe electronic device to: in response to a request for copying the firstrich text being detected, copy the first rich text comprised in thepreview window, or in response to a request for obtaining the first richtext being detected, display the first handwriting input with the firstrich text.
 4. The electronic device of claim 1, wherein the memoryfurther stores instructions cause the processor to control theelectronic device to: detect the first handwriting input and, inresponse to an additional handwriting input not being detected during aspecified time after detecting the first handwriting input or inresponse to a handwriting recognition command by a user being received,perform the handwriting recognition for the first handwriting input. 5.The electronic device of claim 1, wherein the memory further storesinstructions cause the processor to control the electronic device to: inresponse to editing of a portion of the first handwriting input,re-perform the handwriting recognition for a range which has beenspecified with a criterion of the portion.
 6. The electronic device ofclaim 2, wherein the preview window comprises a rich text for aspecified range of the first handwriting input, wherein the specifiedrange comprises one line, a plurality of lines which have been specifiedwith a criterion of a location where the handwriting input has beenprovided, or one screen, and wherein the specified range is changeableby a user.
 7. The electronic device of claim 1, wherein the memoryfurther stores instructions cause the processor to control theelectronic device to: in response to a second handwriting input beingadded after replacing the first handwriting input into the first richtext, identify a relationship between the second handwriting input andthe first rich text, determine a location of a second rich text being aconversion of the second handwriting input based on the identifiedrelationship, and display the second rich text in the determinedlocation.
 8. The electronic device of claim 1, wherein the memoryfurther stores instructions cause the processor to control theelectronic device to: in response to a third handwriting inputoverlapped with at least part of the first rich text being added afterreplacing the first handwriting input into the first rich text, replaceat least part of the first rich text into a third rich text being aconversion of the third handwriting input.
 9. The electronic device ofclaim 1, wherein the memory further stores instructions cause theprocessor to control the electronic device to: classify the firsthandwriting input into a text and a non-text; perform line separationfor the classified text; identify at least one target line which willperform the handwriting recognition; and perform the handwritingrecognition for an entire or part of the identified at least one targetline.
 10. The electronic device of claim 9, wherein the memory furtherstores instructions cause the processor to control the electronic deviceto: output an error message in response to the line separation not beingpossible or the handwriting recognition not being possible.
 11. A methodfor processing a handwriting input in an electronic device, the methodcomprising: converting a first handwriting input of a user into a textby performing handwriting recognition for the first handwriting input;identifying at least one of an attribute or characteristic of the firsthandwriting input; applying at least one of the identified attribute orcharacteristic to the converted text; and replacing, in response to arequest for conversion of the first handwriting input, the firsthandwriting input into a text (hereinafter, a first rich text) to whichthe identified at least one of the attribute or characteristic has beenapplied.
 12. The method of claim 11, further comprising: beforereplacing the first handwriting input into the first rich text,presenting a preview window comprising the first rich text to a locationadjacent to the first handwriting input.
 13. The method of claim 12,further comprising at least one of: in response to a request for copy ofthe first rich text being detected, copying the first rich textcomprised in the preview window, or in response to a request forobtaining of the first rich text being detected, displaying the firsthandwriting input with the first rich text.
 14. The method of claim 11,wherein performing the handwriting recognition comprises one of:performing the handwriting recognition for the first handwriting inputin response to detecting the first handwriting input; in response to anadditional handwriting input not being detected during a specified timeafter detecting the first handwriting input, performing the handwritingrecognition for the first handwriting input; or in response to ahandwriting recognition command by a user being received, performing thehandwriting recognition for the first handwriting input.
 15. The methodof claim 11, further comprising: in response to editing of a portion ofthe first handwriting input being detected, re-performing thehandwriting recognition for a range which has been specified with acriterion of the edited portion.
 16. The method of claim 12, whereinpresenting the preview window comprises presenting a rich text for aspecified range of the first handwriting input through the previewwindow, wherein the specified range comprises one line, a plurality oflines which have been specified with a criterion of a location where thehandwriting input has been provided, or one screen, and wherein thespecified range is changeable by a user.
 17. The method of claim 11,further comprising: detecting an addition of a second handwriting inputafter replacing the first handwriting input into the first rich text;identifying a relationship between the second handwriting input and thefirst rich text; determining a location of a second rich text being aconversion of the second handwriting input, based on the identifiedrelationship; and displaying the second rich text in the determinedlocation.
 18. The method of claim 11, further comprising: detecting anaddition of a third handwriting input overlapped with at least part ofthe first rich text after replacing the first handwriting input into thefirst rich text; and replacing at least part of the first rich text intoa third rich text having converted the third handwriting input.
 19. Themethod of claim 11, wherein performing the handwriting recognitioncomprises: classifying the first handwriting input into a text and anon-text; performing line separation for the classified text;identifying at least one target line which will perform the handwritingrecognition; and performing the handwriting recognition for an entire orpart of the identified at least one target line.
 20. The method of claim19, further comprising outputting an error message in response to theline separation not being possible or the handwriting recognition notbeing possible.